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1 . The amendment filed on 10/27/06 is entered and made of record. 

2. The examiner will withdrawn the statutory and non-statutory obviousness-type double 
patenting in response to the expressed abandonment of applicant number 10/439,991. 

Response to Applicant's Argument 

On page 9, the applicant states: [Bishop fails to teach or suggest a system having a 
lower resolution imaging for detection, and another having a relatively higher resolution 
imaging for reviewing.] 

The examiner disagrees with the applicant. Bishop (US pat no 4,589,140) discloses 
lower resolution imaging for detection (see fig 2 - the image of the electronic part 
showing areas of defects) and another having a relatively higher resolution imaging for 
reviewing (see fig 3 - image B shows a short where it shows more details of the metal 
section as compared to fig 2, which in turn means fig 3 image B must be observe at 
higher resolution). 

[Furthermore, because Bishop uses the same apparatus, Bishop fails to teach or 
suggest concurrent operations of "detecting ..." and "reviewing ..." as recited, in part, in 
claim 1 .] 

The examiner agrees with the applicant. Bishop also discloses observing the electronic 
part at low magnification (low resolution shown in fig 2) and high magnification (higher 
resolution shown in fig 3, see col. 6 lines 36 - 40), but does not explicitly say the 
operator observe the low and high magnification images concurrently. However, in the 
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examiner's updated search Takayama (US pat no 6,674,889) discloses electronic part 
inspection operations of detecting and reviewing are perform concurrently (see col. 4 
lines 53 -58 and fig 1). 

Claim Rejections - 35 USC § 103 

1 . The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 1 02 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

2. Claims 3, 8 and 11 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Bishop ('140) in view of Takayama ('889). 

With regards to claim 3, Bishop discloses a method for detection of defects, concurrent 
with on-the-fly review and classification of defect candidates in a flat patterned object 
under test comprising the following parallel operations 

• acquiring images of the object; detecting defect candidates of said object; and 
assigning review worthiness values to said defect candidates, through a defect 
detection sub- system having a plurality of defect detection sub-system modules 
operative according to a first relatively lower operating resolution (see fig 2 
showing a flat patterned media and lower resolution is shown in fig 9b low 
magnification FOV with defect shown on the upper right corner - if the defect is 
worthy then a higher resolution image of the defect is taken) and 
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• acquiring images of smaller areas around said defect candidates; reviewing said 
smaller areas, and classifying said smaller areas, through a defect review sub- 
system having a plurality of defect review sub-system modules operative 
according to a second relatively higher resolution (see fig 3 showing the defects 
areas of higher resolution of the flat patterned area in fig 2). 
But Bishop does not disclose operator observing the low and high magnification 
electronic part defect images concurrently. Bishop suggests observing both low and 
high magnification images of the electronic part defects at different times as shown in 
figure 4 (the object being inspect is move across a conveyor, at each section a camera 
with a greater magnification takes images of the defects present on the electronic part). 
Takayama discloses electronic part inspection operations of detecting and reviewing are 
perform concurrently (see col. 4 lines 53 - 58 and fig 1). 

It would have been obvious to one having ordinary skill in the art at the time of the 
invention was made to include observing the low and high magnification electronic part 
defect images concurrently because the system or the operator does not have to stop 
inspection process whenever a defect is found, the system can continue scanning for 
defect while being reviewed at the same time, to improve productivity (see col. 3 lines 
28-36). 

With regards to claim 8, Bishop discloses a method according to claim 3 
comprising 



i 
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• generating in the defects detection sub-detection sub-system, a sequence of 
defect candidates (see fig 2 shows a series of defects in sections A - E and 
magnified in fig 3 being a pinhole, short, normal, short and pinhole, respectively), 

• queuing and scheduling the sequence for imaging by a plurality of the defect 
review sub-system modules (see fig 3 the defects are sequenced in alphabetic 
order from A through E and review as being classified as pinhole, short, normal, 
short and pinhole, respectively), 

• dispatching the defect review sub-system modules to perform relatively higher 
resolution imaging of outstanding defect candidates to create a sequence of 
defect candidates associated with the relatively higher resolution image data (see 
fig 3 shows all magnified defects in the flat patterned in fig 2), 

• causing the defects candidates to experience a two stage processing involving: 
an automatic review process and automatic classification process (see col. 4 
lines 21 - 32 - the flat patterned in fig 2 is first scanned completely and the 
process goes back for review for each defects in a higher resolution, 
classification is shown in fig 3 at higher resolution as pinhole, short and normal), 

• during the automatic review process, comparing the high resolution candidate 
image with a reference image stored in system memory of known defects status 
(see fig 1 1i - recognition memory - pattern information used to characterize 
object in run mode, objects as in defects), wherein the comparing comprises 
compensating for known variations between test and reference including 
correcting for at least one of the following: 
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• imaging instrument sensitivities and sensor pixel sensitivity variations (see fig 4 — 
shows different level of magnifications at 5x, 10x and 20x, each magnification 
represent a sensitivity and each magnification represent a resolution), 

conveying information on legitimate defects to for automatic classification processing^ 
thereafter 

• during automatic classification processing, using the relatively higher resolution 
defects image in combination with output of the automatic classification 
processing to extract relevant features of the defect (see fig 3 - shows defects 
shown at higher resolution) and 

• making final decision on type of the defect through the classification processing 
(see fig 3 - shows the type of defects, pinhole and short). 

But Bishop does not explicitly discloses compensating for spatial miss assignment at 
sensor pixel level to result in either the validation of the existence of a legitimate defect 
at the candidate location or rejection of the defect as a false defect including an artifact 
of known limitations of the low resolution DDS sub-system. Bishop discloses eliminating 
the use of critical alignment and operates independently of slight rotation or 
displacement of the object (see col. 19 lines 31 - 33), suggesting that it is well known in 
the art to compensate spatial misalignment by performing critical alignment by Bishop. 
Bishop solves the misalignment problem by using a learning system, to rotate the object 
at all orientations to measure noise at all levels obtaining a noise model (see col. 19 
lines 34 - 44). It would have been obvious to one having ordinary skill in the art at the 
time of the invention was made to construct a noise model because, to compensate for 
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any noise present in the object image to avoid any spatial misalignments to improve the 
imaging system. Further, the process of Bishop effectively compensates for any 
misalignment. 

With regards to claim 1 1 , see the rationale for claim 3. 

3. Claims 4 and 5 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Bishop ('140) and Takayama ('889) as applied to claim 3 further in view of Fukushima 
(US pat no 5,991,688). 

With regards to claim 4, Bishop discloses all of the claim elements / features as 
discussed above in rejection for claim 3 and incorporated herein by reference, and a 
method according to claim 3 comprising maximizing the number of higher priority defect 
candidates captured by said defect review sub-system modules (see fig 3 - the defects 
are prioritized from image A to E), but fails to disclose minimizing distance travel by said 
defect review. However, Bishop discloses one would scan over the entire flat patterned 
media and then later come back to examine candidate defect area using higher 
resolution (see col. 4 lines 24 - 33), which suggest it is best to find the shortest or 
minimum distance to the next candidate defect to save time. Fukushima discloses 
constructing a forward flow graph with nodes corresponding to current position of the 
vehicle and arcs corresponding to feasible motions from current position, for each arc 
signifying a module move from one node to another node (see fig 3 - the nodes located 
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at R0 to R7 and the move start from R0 moving from one node to another sequentially, 
see also col. 10 lines 32 - 49 showing movements from R1 to R3, each node is read as 
a defect). It would have been obvious to one having ordinary skill in the art at the time of 
the invention was made to include a minimum distance calculation because to save time 
and processing power from the system while moving from one defects to another, to 
improve system performance. 

With regards to claim 5, Bishop discloses all of the claim elements / features as 
discussed above in rejection for claim 3 and incorporated herein by reference, but fails 
to disclose constructing a forward flow graph means, solving resulting graph means and 
computing data means. However, Bishop discloses one would scan over the entire flat 
patterned media and then later come back to examine candidate defect area using 
higher resolution (see col. 4 lines 24 - 33 - as well as col. 3 lines 10-30; col. 5 lines 5 
- 30). It is best to find the shortest distance to the next candidate defect to save time. 
Fukushima discloses constructing a forward flow graph with nodes corresponding to 
current position of the vehicle and arcs corresponding to feasible motions from current 
position, for each arc signifying a module move from one node to another node (see fig 
3 - the nodes located at R0 to R7 and the move start from R0 moving from one node to 
another sequentially, see also col. 10 lines 32 - 49 showing movements from R1 to R3), 
associating costs to arcs as a function of cost factors, including a cost of missing other 
nodes (see col. 12 lines 58 - 65 - starting from A the shortest route is from A to B, the 
link from A to C is next shortest route, C is the missing node because C is not use and 
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becomes a missing node and shown in fig 5), distance of necessary motion (see also 
col. 10 lines 32 - 49 - calculating between each node, L, indicates as cost) and 
worthiness of a captured node to obtain a resulting graph (see fig 3 - all the nodes 
shown, R0 - R7, are worthy), solving the resulting graph for minimum cost path from the 
current location of the defect review sub-system module to the last node (see col. 10 
lines 32 - 49 - Lmin is the objective minimum distance goal moving from node to node 
shown in fig 3) and computing motion data for the node for controlling motion (see col. 
14 lines 56 - 57 - the vehicle will reach the destination node after link has been 
confirmed). See the motivation for rejection for claim 4. This will solve system from 
having to make a second pass over the object or from changing modes / magnification 
repeatedly at every potential defect. 

4. Claims 6 and 7 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Bishop ('140) and Takayama ('889) as applied to claim 3 further in view of Yaroslavsky 
(US pub no 2003/01 18245). 

With regards to claim 6, Bishop discloses all of the claim elements / features as 
discussed above in rejection for claim 3 and incorporated herein by reference and 
beginning at a pre-determine distance from a target candidate location and during the 
motion of the defect review sub-system module (see fig 3 - the images taken are 
sections A - E in fig 2, showing pinhole, short defects and normal), but fails to disclose 
automatically focusing the imaging element, focus quality measure means, interpolating 
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sample means and z-axis maximum positioning means. Yaroslavsky discloses obtaining 
a focus quality measure computed over the images to sample a focus quality measure 
computed over the images to sample a focus quality measure computed over the 
images to sample a focus quality curve (see fig 1 - a set of images are create then for 
each image the edge density is computed and plotted on a graph in fig 2), interpolating 
the samples of the focus quality curve with a smoothing function to determine a 
maximizing focus point for a z-stage moving the focusing optics (see fig 2 - the sample 
are Fp1 and Fp2, and from those two or more samples the curve is created, indicating 
two maxima which have the highest edge density corresponding to their image in the 
set) and directing the z-stage to a the z-axis position which maximizes the said focus 
quality metric curve to achieve sharpest focus of the target candidate location (see fig 3 
-finds the optimum focus position of the imaging sensor, optimum position shown in fig 
2 Fp1 and Fp2, the sensor indicating the z-axis position, imager shown in fig 4 also see 
paragraph 4 middle of the paragraph and paragraph 5). The methods described in 
Yaroslavsky are to automatically find the best focus for each image by using focus level 
and edge density graph. It would have been obvious to one having ordinary skill in the 
art at the time of the invention was made to include an auto-focusing system because to 
minimize the errors and variations during focusing on a image to produce the best 
images for inspection (see paragraph 4 - last 7 lines). . 

With regards to claim 7, Bishop discloses all of the claim elements / features as 
discussed above in rejection for claim 3 and incorporated herein by reference and 
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capturing a sequence of image data from an imaging element of the defect review sub- 
system (see fig 3 — image A - E are the sequence of image captured), but fails to 
disclose using sequence of image data in combination with said focus quality measure 
computed over the images to sample the focus quality curve. Yaroslavsky discloses 
using sequence of image data in combination with said focus quality measure computed 
over the images to sample the focus quality curve (see fig 1 - step 110 create a set of 
images of the object then from the images a plot of focus position versus edge density 
is created). See the motivation for claim 6. 

5. Claims 1 , 2, 9 and 10 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Bishop ('140) in view of Takayama ('889) and Yaroslavsky (US pub no 
2003/0118245). 

With regards to claim 1, 2, 9 and 10, see the rejection for claims 3, 6 and 8. In addition, 
Yaroslavsky discloses using automatic focus imaging (see paragraph 5). One skill in the 
art would include automatic focusing because to relieve strait on the photographer, so 
the photographer can focus on taking a more precise image of the electronic part. 

6. Claims 12 and 13 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Bishop ('140) and Takayama ('889) as applied to claim 1 1 further in view of 
Gilliland (US pat no 5,999,642). 
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With regards to claim 12, Bishop discloses all of the claim elements / features as 
discussed above in rejection for claim 1 1 and incorporated herein by reference, but fails 
to discloses defect detection system is mounted on a first moveable gantry. Gilliland 
discloses an apparatus according to claim 7, wherein the defect detection sub-system is 
mounted on a first moveable gantry and the defect review sub-system is mounted on a 
second movable gantry (see fig 1 - 12 first gantry moving along the A and A 1 path and 
fig 1-1 2b second gantry moving along B and B 1 path with a set of cameras, 16A and 
16B), but does not the first and second does not move to together on the same axis. 
Takayama suggests that the reviewing section (see fig 1-4) and detecting section (see 
fig 1 - 5) must move with each other (see col. 6 lines 21 - 30) as the X-Y stage is move 
the optical devices 1 -4 and 1 - 5 are always opposite position of each other. One skill 
in the art would want the reviewing and detecting section together because to use laser 
light to transmit light to the image pick sensor to produce a detail image for inspection. 
It would have been obvious to one having ordinary skill in the art at the time of the 
invention was made to include a pair of gantry because to move along the horizontal 
and vertical to allow images of the object to be capture for inspection. 

With regards to claim 13, see the rejection for claim 12. 

7. Claim 14 is rejected under 35 U.S.C. 103(a) as being unpatentable over Bishop 
('140) in view of Takayama ('889) and Gilliland (US pat no 5,999,642) as applied to 
claim 13 further in view of Fukushima ('688). See the rationale and rejection for claim 5. 
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Conclusion 



Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Alex Liew whose telephone number is (571)272-8623. 
The examiner can normally be reached on 9:30AM - 7:00PM. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Joseph Mancuso can be reached on (571)272-7695. The fax phone 
number for the organization where this application or proceeding is assigned is 571- 
273-8300. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTO Customer Service Representative or access to the automated information 
system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000^ 



Alex Liew 
AU2624 

12/28/06 
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